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Modeling  and  Statistical  Analysis  of  Bioassay  Data: 
Medaka  Cell  Proliferation  under  DEN  and  TCE 


by 

Donald  P.  Gaver 
and 

Patricia  A.  Jacobs 

Department  of  Operations  Research 
Naval  Postgraduate  School 
Monterey,  CA  93943 


1.  INTRODUCTION 

This  report  describes  an  analysis  of  cell  proliferation  data,  by  liver  slice,  from 
an  experiment  using  Japanese  Medaka.  Previous  work  has  used  summary  data 
from  the  same  experiment  (Gaver  and  Jacobs,  1994a,b).  Another  relevant 
reference  is  to  Morris  (1993).  A  brief  description  of  the  experiment  follows. 

The  medaka  are  exposed  to  differing  levels  of  DEN  and  TCE  in  tanks  of 
water.  The  treatment  groups  are:  control,  10  mg//  DEN,  100  mg//  DEN, 
0.1  mg//  TCE,  (10  mg//  DEN  with  0.1  mg//  TCE),  1  mg//  TCE,  and  (10  mg// 
DEN  with  1  mg//  TCE).  Each  treatment  group  has  two  replicate  tanks.  Eight 
animals  in  each  tank  were  sacrificed  on  4  August,  1993;  this  is  sacrifice  B.  Eight 
additional  animals  in  each  tank  were  sacrificed  on  20  August  1993;  this  is 
sacrifice  D. 
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Each  sacrificed  fish  was  exposed  to  BrdU  for  72  hours  prior  to  saaifice;  any 
cell  that  is  in  S-phase  during  this  time  has  a  BrdU  marker.  Each  saaificed  fish  is 
frozen  and  sliced  longitudinally  into  7-micron  sections.  A  third  of  the  slices  are 
stained  with  another  agent.  This  agent  stains  nuclei  with  the  BrdU  marker  black; 
these  nuclei  are  called  positive.  It  is  5  of  the  latter  stained  slices  that  are  analyzed 
subsequently. 

Five  slices  containing  a  portion  of  the  liver  are  considered  for  each  fish.  A 
region  of  interest  (ROD  is  marked  on  the  slice;  the  ROI  is  chosen  to  attempt  to 
maximize  the  number  of  hepatocytes  and  minimize  the  number  of 
nonhepatocytes  present.  The  area  of  all  of  the  hepatocytes  within  the  region  of 
interest  is  measured,  and  the  area  of  positive  nuclei  within  the  region  of  interest 
is  measured.  The  number  of  hepatocytes  in  the  ROI,  and  the  number  of  positive 
hepatocytes  in  the  ROI  were  also  counted  for  half  the  fish  in  sacrifice  B. 

A  count  measure  of  cell  proliferation,  the  count  index  (Cl),  for  a  slice  is  the 
number  of  positive  hepatocytes  in  the  ROI  divided  by  the  number  of  hepatocytes 
in  the  ROI,  multiplied  by  100.  Evaluation  of  this  measure  is  very  labor  intensive. 
As  an  alternative,  the  following  area  index  (AI)  is  used 

Area  of  positive  nuclei  in  the  ROI 
AI  =  Area  Index  =  hepatocytes  in  the  ROI  ^ 

The  area  index  is  easier  to  obtain;  however,  it  does  not  quantify  cells  in  S-phase 

exactly  as  does  the  Cl  since  cells  are  of  different  size,  as  are  the  areas  resulting 

from  the  slicing  process,  which  are  the  result  of  a  random  intersection  with  the 

cell. 

Figure  1  displays  a  plot  of  the  count  index  (divided  by  100)  versus  area  index 
(divided  by  100),  computed  by  slice,  for  those  fish  of  sacrifice  B  for  which  both 
measures  are  available,  along  with  a  simple  unweighted  least-squares-fitted 
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straight  line;  also  displayed  is  the  least-squares  line  equation  with  the  standard 
errors  of  the  coefficients  displayed  in  parentheses  below  the  coefficients.  There 
appears  to  be  a  satisfactory  linear  relationship  between  the  count  index  and  area 
index,  indicating  that  AI  and  Cl  are  generally  measuring  the  same  response. 
However  the  variability  of  the  area  index  increases  as  the  coimt  index  increases; 
this  increase  is  generally  associated  with  high  DEN  and  TCE  dose  levels;  its 
biological  interpretation  is  not  yet  available.  It  suggests  that  cell  sizes  become 
more  variable  under  dosage. 

Figure  2  is  a  display  of  the  slice  area  indices  (divided  by  100),  by  fish,  for  the 
two  control  tanks.  Note  the  variability  between  fish  and  the  somewhat  greater 
variability  between  fish  in  tank  2  as  compared  to  those  in  tank  1. 

Several  slice  area  datum  appear  to  be  missing  or  are  of  doubtful  validity. 
These  have  been  deleted  from  analytical  consideration.  They  are  listed  in  Table  1. 
An  alternative  might  have  been  to  use  robust  statistical  procedures  throughout; 
such  procedures  automatically  down-weight  highly  discrepant  observations. 
Furthermore,  examination  of  the  weights  indicates  discrepancy  so  that 
explanations  can  be  sought.  It  seems  likely  that  robust  methods  should  be  more 
widely  used  in  environmental  toxicology.  Robust  statistical  methods  are 
discussed  seriously  in  Cox  and  Hinkley  (1974).  A  less  advanced  treatment 
appears  in  Koopmann  (1987). 

A  summary  of  the  findings  of  the  data  analysis  is  as  follows, 
a.  Available  data  from  sacrifice  B  suggests  that  there  is  a  reasonably  strong 
linear  association  between  the  count  index  and  the  area  index.  For  ease  of 
analysis  the  area  index  has  been  used  throughout. 
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Slices  Not  Considered  in  the  Data  Analysis 


MISSING  SLICES:  SACRIHCE  B 

Missing  Measurements  are  left  blank. 

ID 

No.  of 
Slices 

Tank 

Treatment 

Reason 

9273802 

All 

8 

0.1  TCE 

Blank  field 

9273811 

AU 

9 

10  DEN, 

0.1  TCE 

Blank  field 

MISSING  SLICES:  SACRIFICE  D 

Missing  Values  appear  to  be  coded  with  0. 

ID 

No.  of 
Slices 

Tank 

Treatment 

Reason 

9273986 

All 

2 

Control 

Area  ROI  =  Positive  Area  =  0 

9285049 

All 

10 

ITCE 

Area  ROI  =  Positive  Area  =  0 

9274001 

All 

4 

10  DEN 

All  positive  areas  =  0  with  2  slices 
having  1  mit.  hep. 

9285079 

All 

14 

10  DEN, 
ITCE 

All  positive  areas  =  0  with  3  slices 
having  1  mit.  hep. 

9285022 

1 

7 

0.1  TCE 

Area  of  ROI  =  247.16,  others  of 
order  7500 

9285043 

1 

9 

10  DEN, 

0.1  TCE 

Positive  area  of  slice  =  0; 

0  mit.  cells 

9285073 

1 

13 

10  DEN, 
ITCE 

Positive  area  of  slice  =  0; 

0  mit.  cells 

b.  There  is  evidence  that  the  variances  of  the  slice  area  indices  over  fish  exposed 
to  various  treatments  are  approximately  equal  to  the  corresponding  means. 
This  relationship  can  lead  to  misleading  conclusions  if  standard  statistical 
procedures  are  used  uncritically;  furthermore,  the  results  are  less  efficient 
than  necessary.  However,  the  variances  of  the  square  roots  of  the  slice  area 


indices  for  fish  subjected  to  the  various  treatment  (DEN  and  TCE)  levels 
appear  approximately  constant,  i.e.  far  less  dependent  on  the  corresponding 
mean  values.  Consequently,  the  square  roots  of  the  area  indices  are  used  in 
subsequent  data  analyses.  The  underlying  reason  for  the  above  data  behavior 
is  that  positive  counts  are  rare  random  events,  hence  tend  to  be 
approximately  Poisson  distributed.  The  square  root  transformation  is  known 
to  stabilize  the  variance  of  such  counts;  see  Miller  (1986),  p.  59.  The  same 
transformation  should,  and  here  does,  stabilize  the  variance  of  count- 
associated  areas. 

c.  The  means  of  the  fish  mean  square  root  of  area  indices  are  considered  for  both 
sacrifices.  There  is  generally  more  treatment  effect  for  sacrifice  B  than  for 
sacrifice  D:  examine  p-values  in  lines  3  of  Tables  2  and  3  for  the  overall 
analysis  of  variance  indications  to  see  that  sacrifice  D  p-values  are  always 
larger  than  those  for  sacrifice  B.  Four  out  of  five  of  the  treatment  means  are 
significantly  larger  (at  the  95%  level)  than  that  for  the  control  for  sacrifice  B. 
There  is  no  significant  difference  (95%  level)  between  the  treatment  means 
and  the  control  mean  for  sacrifice  D.  For  sacrifice  B,  the  treatment  means  for 
two  out  of  the  three  levels  of  TCE  with  10  mg/^  DEN  are  significantly  larger 
than  those  without  DEN  for  sacrifice  B;  there  is  no  significant  difference  for 
sacrifice  D. 

d.  The  control  mean  for  sacrifice  D  is  significantly  larger  than  the  control  mean 
for  sacrifice  B.  The  other  treatment  means  for  sacrifice  D  are  not  significantly 
different  than  those  for  sacrifice  B. 
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e.  There  is  some  suggestion  that  in  the  later  sacrifice  D,  the  presence  of  TCE 
lowers  the  mean  of  the  area  index.  The  biological  mechanisms  likely  to  explain 
this  behavior  are  not  yet  available. 

The  above  results  are  from  one-way  analysis  of  variance  (ANOVA)  of  the 
square  roots  of  the  area  indices,  augmented  by  multiple  comparison  methods;  the 
latter  allow  all  possible  pairwise  comparisons  to  be  made  with  a  specified 
experiment-wise  error  rate,  here  5%. 

Brief  Overall  Siunmary  of  Findings  to  Date 

The  above  can  be  briefly,  and  simplistically,  summarized  as  follows.  While  it 
can  be  said  that  there  is  a  statistically  significant  difference  between  mean 
responses  (yfM)  to  the  various  treatments  with  DEN  and  TCE,  no  simple  and 
interpretable  dose-response  patterns  have  been  found.  In  particular,  response 
does  not  appear  to  increase  (or  decrease)  systematically  with  dose  increase, 
where  "dose"  includes  time  of  exposure  as  well  as  increases  in  chemical 
concentration  dose  levels.  It  remains  to  be  seen  whether  the  latter  inconclusivity 
is  lessened  by  the  analysis  of  more  data  (later  sacrifices),  by  finding  that 
experimental  problems  or  biases  occurred,  or,  more  exciting,  that  the  dose- 
responses  observed  can  be  explained  by  biological  mechanism,  and  that  the 
findings  essentially  reappear  when  further  experiments  and  data  analyses  are 
conducted. 

Section  2  presents  results  of  graphical  displays  of  the  data.  Section  3  presents 
results  of  exploratory  analyses  of  variance.  Results  of  exploratory  linear 
regression  models  are  presented  in  Section  4.  Multiple  comparison  results  appear 
in  Section  5. 
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2,  GRAPHICAL  SUMMARIES  OF  THE  SLICE  AREA  INDICES 

Figure  3a  (respectively  3b)  displays  boxplots  of  the  slice  area  indices  by  tank 
for  sacrifice  B,  (respectively  sacrifice  D).  The  boxplots  may  be  viewed  as  a 
graphical  one-way  analysis  of  variance.  There  is  some  tank  effect  within  a 
treatment  group.  The  greatest  dose-response  effect  is  clearly  for  the  100  DEN 
treatment. 

Figures  4a  and  4b  display  plots  of  the  mean  of  the  area  indices  for  each  tank 
versus  the  variance  of  the  area  indices  for  each  tank.  Also  displayed  is  a  45°  line. 
There  appears  to  be  a  linear  relationship  between  the  mean  and  variance;  in  fact, 
the  variances  appear  to  be  approximately  equal  to  the  means.  This  relationship 
between  the  means  and  variances  may  lead  to  misleading  results  if  analysis  of 
variance  techniques  are  applied  directly  to  the  slice  area  indices;  Miller  (1986) 
and  Box  (1954)  discuss  the  effects  of  inequality  of  variance  on  one-way  analysis 
of  variance.  It  is  believed  that  such  effects  may  well  appear  often  in 
environmental  toxicology,  particularly  where  counts,  or  count-like  phenomena, 
are  found. 

As  noted  earlier,  one  standard  transformation  that  can  be  applied  to  data  with 
variances  approximately  equal  to  means  to  attempt  to  make  the  variance  of  the 
transformed  data  more  nearly  constant  is  the  square  root  transformation;  see  Miller 
(1986).  Figures  5a  and  5b  display  plots  of  the  mean  of  the  square  root  of  the  area 
indices  for  each  tank  versus  the  variance  of  the  square  root  of  the  area  indices  for 
each  tank.  The  variances  now  appear  unrelated  to  the  corresponding  means. 
Figures  6a  and  6b  display  boxplots  of  the  square  roots  of  the  slice  area  indices  by 
tank.  Note  that  the  lengths  (heights  between  quartiles)  of  the  boxes  are  less 
variable  than  are  those  for  the  boxplots  of  the  raw  area  indices  themselves.  In  the 
remainder  of  this  paper  the  square  root  of  area  indices  will  be  used. 
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3.  EXPLORATORY  ANALYSES  OF  VARIANCE 

Results  of  exploratory  analyses  of  variances  appear  in  Tables  2-4.  The  basic 
data  are  summaries  of  area  indices  and  the  square  roots  of  area  indices  for  each 
fish.  Since  the  boxplots  indicate  that  the  100  DEN  treatment  is  associated  with 
much  larger  area  indices,  the  analyses  of  variances  were  done  with  and  without 
100  DEN.  Table  2  shows  the  results  by  tank.  Recall  that  small  p-values  will 
indicate  tank,  hence  treatment,  effect.  The  first  row  of  the  table  indicates  that  the 
tank  means  of  the  fish  mean  area  index  are  significantly  different.  However  the 
second  row  of  the  table  indicates  that  the  tank  means  of  the  logarithms  of  the 
variance  (log  variance)  of  area  indices  for  each  fish  are  also  significantly  different. 
The  graphical  analysis  has  already  indicated  this  difference.  Now  recall  that  one 
of  the  assumptions  of  analysis  of  variance  is  that  the  data  come  from  populations 
with  equal  variance,  so  apply  the  square-root  transformation.  Rows  3  and  4 
report  results  using  the  square  roots  of  the  area  indices.  Note  that  the  results  of 
row  4  indicate  that  there  is  no  significant  difference  between  the  tank  means  of 
the  log  variance  of  the  slice  square  root  of  area  index  for  each  fish.  However,  the 
results  of  row  3  indicate  that  there  is  significant  difference  between  the  tank 
means  of  the  mean  of  the  slice  square  root  area  indices  for  each  fish;  note  that  the 
p-values  for  the  tank  means  are  smaller  using  the  fish  mean  square  root  of  area 
indices  rather  than  the  raw  (untransformed)  area  indices  for  the  analysis  of 
variance  (without  the  100  DEN  treatment).  Thus,  the  difference  in  variances  of 
the  raw  (untransformed)  area  indices  appears  to  have  masked  some  of  the 
difference  in  means,  presumably  resulting  from  treatment  effects. 

Table  3  displays  results  for  analyses  of  variance,  with  the  two  tanks  in  each 
treatment  combined.  Once  again,  the  analysis  of  variance  using  the  mean  slice 
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square  root  of  the  area  indices  for  each  fish  indicates  that  there  is  a  significant 
difference  between  treatment  means  of  the  means,  even  without  100  DEN. 

TABLETS 

p-Values  for  Exploratory  ANOVA  of  Area  Indices  (AI)  by  Tank 
(AI  =  [(Positive  AreaVROI  Area]  x  100) 

(Small  p-Values  Indicate  Chemical-Tank  Effect) 


Sacrifice  B 

Saaifice  D  | 

Data 

with 

100  DEN 

without 
100  DEN 

with 

100  DEN 

without 
100  DEN 

Mean  slice  AI  for  each  fish  in  a 
tank 

<  10-16 

3x10-5 

6  X  10-16 

2.9  X  10-2 

Log  variance  of  slice  AI  for 
each  fish  in  a  tank 

4  X  10-11 

2x10-5 

3  X  10-2 

0.54 

Mean  slice  for  each  fish  in 

a  tank 

4  X  10-16 

8x10-7 

1  X  10-14 

1.6  X  10-2 

Log  variance  of  slice  for 

each  fish  in  a  tank 

0.16 

0.25 

0.89 

0.97 

TABLE  3 

p-Values  for  Exploratory  ANOVA  of  Area  Indices  (AI)  by  Treatment 
(AI  =  [(Positive  Area)/ROI  Area]  x  100) 

Treatment:  2  Tanks  Combined 
(Small  p-Values  Indicate  Treatment  Effect) 


Sacrifice  B 

Sacrifice  D 

Data 

with 

100  DEN 

without 
100  DEN 

with 

100  DEN 

without 
100  DEN 

Mean  slice  AI  for  each  fish  in  a 
treatment 

1  X  10-16 

1x10-5 

1  X  10-16 

2x10-2 

Log  variance  of  slice  AI  for 
each  fish  in  a  treatment 

4  X  10-13 

3x10-6 

1  X  10-4 

0.33 

Mean  slice  "n/aI  for  each  fish  in 
a  treatment 

2  X  10-16 

9x10-7 

4  X  10-16 

9  X  10-3 

Log  variance  of  slice  for 

each  fish  in  a  treatment 

0.19 

0.46 

0.56 

0.89 
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Table  4  displays  results  of  an  analysis  of  variance  of  the  mean  square  root  of 
area  indices  for  each  fish  in  a  treatment  but  without  the  control.  Once  again  there 
is  evidence  of  significant  differences  between  the  treatment  means. 

We  conclude  that  there  is  a  definite  treatment  effect,  i.e.  response  to  different 
treatment  levels,  even  if  no  treatment  =  control  and  the  "strong"  100  DEN 
treatment  responses  are  removed. 


TABLE  4 

p-Values  for  Exploratory  ANOVA  of  Area  Indices  (AI)  by  Treatment 

Without  Control 

(AI  =  [(Positive  Area)/ROI  Area]  x  100) 

Treatment:  2  Tanks  Combined 
(Small  p-Values  Indicate  Treatment  Effect) 


Sacrifice  B 

Sacrifice  D 

Data 

with 

100  DEN 

without 
100  DEN 

with 

100  DEN 

without 
100  DEN 

Mean  ^[m  for  fish 

0 

1.9x10-3 

5.9  X  10-15 

7.4  X  10-3 

4.  EXPLORATORY  LINEAR  REGRESSION 

Tables  5-8  report  results  of  fitting  exploratory  linear  regression  models  to 
the  square  root  of  the  slice  area  indices  for  each  fish.  For  Tables  5  and  6,  the 
covariates  are  the  level  of  DEN  minus  its  mean;  the  level  of  TCE  minus  its  mean; 
and  an  interaction  term:  {(level  of  DEN  minus  its  mean)  times  (level  of  TCE 
minus  its  mean)}.  The  means  were  subtracted  to  give  the  interaction  term  a  value 
other  than  0  if  the  level  of  DEN  or  the  level  of  TCE  is  0.  The  linear  regressions 
were  fit  with  and  without  the  100  DEN  treatment.  The  results  of  Table  5  are  for 
sacrifice  B  and  those  of  Table  6  are  for  sacrifice  D. 
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TABLE  5 
Sacrifice  B:  ^[A^ 

Linear  Regression  Coefficient  Estimates  with  Standard  Error 
and  95%  Normal  Confidence  Intervals 


CONSTANT 

(SE) 

[Cl] 

1 

DEN- DEN 

(SE) 

[Cl] 

WITHOUT  100  i 

TCE-ra 

(SE) 

[Cl] 

DEN 

(DEN-DEN)x 

(TCE-TCE) 

(SE) 

[Cl] 

R2 

s.e. 

1.88 

0.037 

0.526 

0.025 

0.15 

0.50 

(0.067) 

(0.005) 

(0.148) 

(0.010) 

[1.75,2.01] 

[0.028,0.046] 

[0.237,0.816] 

[0.005,0.045] 

DEN  =5.0  TCE  =  0.372 

1.77 

0.029 

WITH  100  DE 

0.710 

:n 

0.039 

0.56 

0.50 

(0.040) 

(0.003) 

(0.117) 

(0.008) 

[1.69,1.85] 

[0.024,0.033] 

[0.48,0.94] 

[0.02,0.05] 

DEN  =  18.81  TCE=  0.318 

TABLE  6 
Sacrifice  D: 

Linear  Regression  Coefficient  Estimates  with  Standard  Error 
and  95%  Normal  Confidence  Intervals 


CONSTANT 

(SE) 

[Cl] 

1 

DEN- DEN 

(SE) 

[Cl] 

WITHOUT  100. 

TCE-TCE 

(SE) 

[Cl] 

DEN 

(DEN-DEN)x 

(TCE-TCE) 

(SE) 

[Cl] 

R2 

s.e. 

1.89 

0.028 

-0.402 

-0.025 

0.08 

0.50 

(0.07) 

(0.005) 

(0.151) 

(0.01) 

[1.76,2.03] 

[0.02,0.04] 

[-0.70,-0.11] 

[-0.05,-0.005] 

DEN  =4.88  TCE=0.37 

1.68 

0.013 

WITH  100  DE 

-0.050 

:n 

0.0005 

0.45 

0.50 

(0.04) 

(0.003) 

(0.12) 

(0.008) 

[1.60,1.76] 

[0.008,0.018] 

[-0.29,0.19] 

[-0.02,0.02] 

DEN  =  19.05  TCE=  0.315 
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In  both  tables  the  values  of  R?-  are  small  when  the  100  DEN  data  are  excluded. 
This  implies  that  a  linear  function  of  the  above  explanatory  variables  does  not 
explain  the  data  well.  However,  the  standard  errors  of  the  estimates  are  also 
small.  This  behavior  suggests  that,  although  there  may  be  an  association  between 
levels  of  DEN  and  TCE  and  the  square  root  of  the  area  index,  that  association  is 
not  linear.  Note  that  for  saaifice  B  all  of  the  estimates  of  the  coefficients  are 
significantly  positive,  suggesting  that  increasing  levels  of  DEN  and  TCE  are 
associated  with  higher  area  indices.  However,  for  sacrifice  D,  the  estimate  of  the 
coefficient  of  the  level  of  TCE  and  the  estimate  of  the  coefficient  of  the  interaction 
term  coefficient  are  significantly  negative  for  the  regression,  even  without  the  100 
DEN  treatment.  This  suggests  that  for  the  later  sacrifice,  exposure  to  TCE  may 
have  an  inhibitory  effect.  The  only  estimate  of  covariate  that  is  significantly 
different  from  0  for  sacrifice  D  when  100  DEN  is  included  is  exposure  to  DEN. 

Tables  7  and  8  report  results  of  fitting  linear  regressions  with  the  covariate 
being  the  level  of  TCE  exposure  to  data  from  fish  not  exposed  to  DEN  and  to 
data  from  fish  exposed  to  10  mg/£  DEN;  the  dependent  variable  is  the  square 
root  of  the  slice  area  index.  The  R'^  values  are  very  small,  indicating  a  lack  of 
linear  fit,  but  the  estimate  coefficients  for  TCE  in  the  regressions  using  data  from 
fish  exposed  to  10  mg/ ^  DEN  are  formally  significant.  Once  again,  this  behavior 
suggests  that  there  may  be  an  association  but  the  association  is  not  linear. 

For  sacrifice  B,  there  was  no  significant  effect  for  the  level  of  TCE  for  the  fish 
not  exposed  to  DEN;  for  those  fish  exposed  to  10  mg/^  DEN  the  coefficient  for 
level  of  TCE  is  significantly  positive  indicating  that  increasing  levels  of  TCE  are 
associated  with  increasing  (square  roots  of)  area  indices. 
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TABLE  7 
Sacrifice  B;  -s/AI 

Linear  Regression  Coefficient  Estimates  with  Standard  Error 
and  95%  Normal  Confidence  Intervals 
_ (Replicate  Tanks  Pooled) _ 


CONSTANT 

(SE) 

[Cl] 

NODE! 

TCE 

(SE) 

[CIl 

DEN 

(SE) 

[Cl] 

R2 

s.e. 

1.18 

0.056 

- 

0.002 

0.55 

(0.047) 

(0.080) 

- 

[1.09, 1.27] 

[-0.10, 0.21] 

- 

1.47 

10  DEN 

0.31 

r 

0.09 

0.44 

(0.037) 

(0.06) 

- 

[1.40, 1.54] 

[0.18, 0.43] 

- 

1.14 

0  DEN  and  11 

0.18 

IDEM 

0.038 

0.14 

0.50 

(0.038) 

(0.051) 

(0.005) 

[1.06, 1.21] 

[0.08, 0.28] 

[0.29, 0.047] 

In  sacrifice  D,  for  those  fish  not  exposed  to  DEN,  the  estimate  of  the 
coefficient  of  TCE  is  not  significantly  different  than  0.  However,  for  those  fish 
exposed  to  10  mg/^  DEN  the  estimate  of  the  coefficient  of  TCE  is  significantly 
negative,  suggesting  that  for  the  fish  of  the  later  sacrifice  that  were  exposed  to 
DEN,  the  greater  the  level  of  TCE  exposure,  the  smaller  the  (square  root  of)  the 
area  index.  This  effect  calls  for  biological  explanation. 
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TABLE  8 
Sacrifice  D: 

Linear  Regression  Coefficient  Estimates  with  Standard  Error 
and  95%  Normal  Confidence  Intervals 
_ (Replicate  Tanks  Pooled) _ 


CONSTANT 

(SE) 

[Cl] 

NO  DEI 

TCE 

(SE) 

[Cl] 

sf 

DEN 

(SE) 

[Cl] 

R2 

s.e. 

1.35 

0.059 

- 

0.004 

0.43 

(0.037) 

(0.062) 

- 

[1.27, 1.42] 

[-0.063, 0.181] 

- 

10  DEN  1 

1.71 

-0.189 

- 

0.02 

0.56 

(0.048) 

(0.083) 

- 

[1.61, 1.80] 

[-0.352,  -0.026] 

- 

ODEN  and  10  DEN 

1.39 

-0.061 

0.027 

0.07 

0.50 

(0.038) 

(0.052) 

(0.005) 

[1.32, 1.47] 

[-0.16, 0.04] 

[0.017, 0.036] 

5.  MULTIPLE  COMPARISONS 

The  exploratory  analyses  of  variances  strongly  rejected  the  null  hypothesis 
that  all  the  treatment  means  (even  without  the  100  DEN  treatment)  of  the  fish 
mean  square  root  of  the  area  indices  are  equal.  Rejection  of  the  null  hypothesis 
does  not  indicate  specifically  which  means  are  not  equal.  A  method  for 
discovering  which  means  differ  is  called  a  multiple  comparisons  procedure. 
There  are  a  number  of  different  multiple  comparisons  procedures  in  the  literature; 
see  Miller  (1981).  We  will  use  two  of  them. 
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5.1  Simultaneous  Confidence  Intervals  using  Studentized  Range  Distribution 
The  first  procedure  uses  the  studentized  range  distribution  to  construct 
simultaneous  confidence  statements  about  the  true  values  of  all  differences  of  the 
treatment  means.  Table  9  describes  the  procedure  to  obtain  simultaneous  95% 
confidence  intervals  for  all  differences  of  treatment  means  for  one  sacrifice 
without  the  100  DEN  treatment.  The  original  procedure  requires  that  there  be  an 
equal  number  of  fish  in  each  treatment.  However,  Ott  et  al.  suggest  step  4  in 
Table  9  if  the  number  of  fish  in  each  treatment  do  not  differ  by  much. 

5.1a  Treatment  Means  Minus  Control  Mean 

Figure  7  presents  some  of  the  95%  simultaneous  confidence  intervals  of  the 
differences  of  treatment  means  for  sacrifice  B.  It  shows  the  confidence  intervals 
for  the  treatment  means  minus  the  control  mean  for  the  fish  mean  square  root  of 
the  area  indices.  Note  that  4  out  of  the  5  intervals  are  significantly  above  0 
indicating  that  the  treatments  are  associated  with  a  larger  mean  square  root  area 
indices  than  those  for  the  control.  The  greatest  difference  is  that  for  the  treatment 
of  10  mg/^  DEN  with  1  mg/ £  TCE. 

Figure  8  presents  some  of  the  95%  simultaneous  confidence  intervals  for  the 
later  sacrifice  D,  It  shows  the  confidence  intervals  for  the  treatment  mean  minus 
the  control  mean.  None  of  the  treatment  means  is  significantly  different  from  the 
control  mean. 

5.1b  Treatment  Means  for  Treatments  with  Exposure  to  10  mg//  DEN  Minus 
Those  without  Exposure  to  10  mg//  DEN 

Figure  9  displays  the  saaifice  B  95%  simultaneous  confidence  intervals  for  the 

difference  between  the  treatment  means  for  mean  fish  square  root  of  the  area 

indices  for  those  treatments  with  10  mg//  DEN  minus  the  treatment  means  for 

those  treatments  without  10  mg//  DEN,  by  level  of  TCE  exposure.  Note  that  the 
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treatment  means  with  10  mg/^  DEN  is  significantly  larger  than  that  without  for 
0  mg//  TCE  and  1  mg//  TCE.  There  is  no  significant  difference  for  0.1  mg// 
TCE. 

TABLE  9 

To  Obtain  Tukey  (Studentized  Range  Distribution)  Simultaneous  95% 
_ Confidence  Intervals  for  Treatment  Mean  Differences^  One  Sacrifice 

1.  There  are  6  treatments:  Control;  10  DEN;  0.1  TCE;  10  DEN  with  0.1  TCE; 

1  TCE;  and  10  DEN  with  1  TCE.  _ _ 

f  ^ 

2.  There  are  ~88  within  degrees  of  freedom  ^  (m,-  - 1)  where  rij  is  the  number 

l/=l 

•\ 

of  fish  in  treatment  i  . 

_ I _ 

3.  The  0.05  percentage  point  for  the  studentized  range  for  60  within-degrees- 
of-freedom  and  6  treatment  means  is  4.16,  from  published  tables, 
BIOMETRIKA  Tables  for  Statisticians,  Vol.  1.  This  is  larger  than  the 
percentage  point  for  88  within-degrees-of-freedom.  Thus,  the  constructed 
confidence  intervals  will  be  conservative:  one  can  truly  say  that  all  pairwise 
difference  comparisons  are  made  with  (95%)  confidence. 

4.  Since  the  number  of  fish  per  treatment  differs  somewhat  (due  to  mssing 
fish)  the  harmonic  mean  of  the  number  of  fish  per  treatment  is  used 

6 

”1  «6 

where  nj  is  the  number  of  fish  in  treatment  i. 

5.  The  mean  square  within  is 

^ - =  MS(within) 

f=i 

where  y^y  is  the  meanVAI  for  fish  /  in  treatment  i  and  y,-.  is  the  mean  of  the 
mean  ■'/aI  for  the  fish  in  treatment  /. 

6.  95%  confidence  intervals  for  all  pairs  of  means  /i/  and  /// 

(Fi-  “  Fz'  )  -  (4.1 6).^MS( within)/ n 
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Figure  10  displays  a  similar  plot  for  the  later  sacrifice  D.  There  is  no 
significant  difference  between  the  treatment  means  with  10  mg//  DEN  and  those 
without. 

5.1c  Treatment  Means  for  Sacrifice  D  Minus  Treatment  Means  for  Sacrifice  B 
Simultaneous  confidence  intervals  are  computed  for  all  differences  of  the 
treatment  means  of  the  fish  mean  square  root  of  the  area  indices  for  sacrifices  B 
and  D  combined.  Figure  11  displays  six  of  the  95%  simultaneous  confidence 
intervals.  It  displays  the  95%  confidence  intervals  for  the  difference  in  treatment 
means  between  sacrifice  D  and  sacrifice  B.  The  only  significant  difference  is  for 
the  control  where  the  mean  of  the  fish  mean  square  root  of  area  indices  for 
sacrifice  D  is  significantly  larger  than  that  for  sacrifice  B. 

5.2  Studentized  Maximiun  Modulus  Confidence  Intervals 

Simultaneous  confidence  intervals  for  the  treatment  means  themselves  can  be 
constructed  using  the  studentized  maximum  modulus  procedure;  cf.  Miller 
(1981).  The  procedure  is  as  follows  for  the  mean  fish  square  root  area  index  for 
the  three  treatment  groups  (10  mg//  DEN,  0  mg//  TCE),  (10  mg//  DEN, 
0.1  mg//  TCE),  and  (10  mg//  DEN,  1  mg//  TCE)  for  1  sacrifice. 

To  Obtain  Simultaneous  Confidence  Intervals  for  3  Treatment  Means  using  the 
Studentized  Maximum  Modulus  Distribution 

1.  Compute  the  within  degrees  of  freedom  for  the  three  treatments. 

j=l 

where  ni  is  the  number  of  fish  in  treatment  i. 
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2.  Compute  the  mean  square  within 


MS(  within)  =  -  - 

1=1 

where  yij  is  the  mean  square  root  of  the  area  indices  for  fish  j  in  treatment  i 
and  y,-.  is  the  mean  of  the  fish  means  in  treatment  i. 

3.  Find  the  upper  0.05  point  of  the  studentized  maximum  modulus  distribution 
with  parameters  3  (treatments)  and  d  degrees  of  freedom,  m(3,  d).  Tables  can 
be  found  in  Miller  (1981). 

4.  The  three  simultaneous  95%  confidence  intervals  are 

yj.  ±  wj(3,if)-^MS(within)/«/ . 

Figure  12  displays  the  95%  simultaneous  confidence  intervals  for  sacrifice  B 
for  the  means  of  the  fish  mean  of  the  square  root  of  the  slice  area  indices  for  those 
treatments  having  fish  exposed  to  10  mg/^  DEN.  The  means  appear  about  the 
same  for  0  mg/£  TCE  and  0.1  mg/£  TCE.  The  mean  for  1  n\g/£  TCE  appears  to  be 
somewhat  larger. 

Figure  13  displays  the  95%  simultaneous  confidence  intervals  for  saaifice  D 
for  the  means  of  those  treatments  with  10  mg/^  DEN  by  level  of  TCE.  There  is 
some  suggestion  that  the  presence  of  TCE  is  associated  with  a  lower  mean  of  the 
fish  mean  square  root  of  the  slice  area  indices. 

CONCLUSION 

The  above  analyses  illustrate  the  use  of  statistical  methods  appropriate  for  the 
kinds  of  data  obtained  by  the  medaka  experiments.  The  methods  of 
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transformation,  analysis  of  variance,  and  multiple  comparisons  are  useful  and 
powerful  for  the  initial  data  analyses,  suggesting  some  surprising  dose-response 
relations  that  are  worthy  of  careful  further  biological  investigation  and 
explanation.  Alternative  methods  can  also  be  applied,  and  should  yield  the  same 
general  insights. 
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AREA  INDEX  VERSUS  COUNT  INDEX  BY  SLICE 
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Birmingham  B15  2TT 
ENGLAND 

17.  Professor  Sir  David  Cox . 1 

Nuffield  College 

Oxford,  OXI  INF 
ENGLAND 
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18.  Professor  H,  G.  Daellenbach . 1 

Department  of  Operations  Research 

University  of  Canterbury 
Christchurch,  NEW  ZEALAND 

19.  Dr.  S.R.  Dalai . 1 

Bellcore 

445  South  Street 
Morristown,  NJ  07962-1910 

20.  Dr.  D.  F.  Daley . 1 


Statistic  Dept.  (I.A.S.) 

Australian  National  University 
Canberra,  A.C.T.  2606 
AUSTRALIA 


21.  Dr.  B.  Doshi . 1 

AT«&T  Bell  Laboratories 

HO  3M-335 
Holmdel,NJ  07733 

22.  Naihua  Duan . 1 

RAND  Corporation 

Santa  Monica,  CA  90406 

23.  Prof.  Bradley  Efron . 1 


Statistics  Dept. 

Sequoia  Hall 
Stanford  University 
Stanford,  CA  94305 

24.  Dr.  Guy  Fayolle . 1 

I.N.R.I.A. 

Dom  de  Voluceau-Rocquencourt 
78150  Le  Chesnay  Cedex 
FRANCE 

25.  Dr.  M.  J.  Fischer . 5 

Defense  Communications  Agency 

1860  Wiehle  Avenue 
Reston,  VA  22070 


40 


26.  Prof.  George  S.  Fishman . 

Curr.  in  OR  &  Systems  Analysis 

University  of  North  Carolina 
Chapel  Hill,  NC  20742 

27.  Henry  S.  Gardner . 

U.S.  Army  Biological  Research  &  Development  Laboratory 
Ft.  Detrick,  MD  21702-5010 

28.  Dr.  Neil  Gerr . 

Office  of  Naval  Research 

Arlington,  VA  22217 

29.  Prof.  Linda  V.  Green . 

Graduate  School  of  Business 

Columbia  University 
New  York,  NY  10027 

30.  Dr.  D.  C.  Hoaglin . 

Department  of  Statistics 

Harvard  University 
1  Oxford  Street 
Cambridge,  MA  02138 

31.  Prof.  D.  L.  Iglehart  . . 

Dept,  of  Operations  Research 

Stanford  University 
Stanford,  CA  94350 

32.  Institute  for  Defense  Analysis . 

1800  North  Beauregard 

Alexandria,  VA  22311 

33.  Prof.  J.  B.  Kadane . 

Dept,  of  Statistics 

Carnegie-Mellon  University 
Pittsburgh,  PA  15213 

34.  Dr.  Jon  Kettenring . 

Bellcore 

445  South  Street 

Morris  Township,  NJ  07962-1910 
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35.  Koh  Peng  Kong . 

OA  Branch,  DSO 

Ministry  of  Defense 
Blk  29  Middlesex  Road 
SINGAPORE  1024 

36.  Dr.  Prabha  Kumar 

Defense  Communications  Agency . 

1860  Wiehle  Avenue 
Reston,  VA  22070 

37.  Dr.  A.  J.  Lawrence . 

Dept,  of  Mathematics, 

University  of  Birmingham 

P.  O.  Box  363 
Birmingham  B15  2TT 
ENGLAND 

38.  Prof.  M.  Leadbetter . 

Department  of  Statistics 
University  of  North  Carolina 
Chapel  Hill,  NC  27514 

39.  Prof.  J.  Lehoczky . 

Department  of  Statistics 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 

40.  Dr.  Colin  Mallows . 

AT&T  Bell  Telephone  Laboratories 
600  Mountain  Avenue 

Murray  Hill,  NJ  07974 

41.  Prof.  R.  Douglas  Martin . 

Department  of  Statistics,  GN-22 
University  of  Washington 
Seattle,  WA  98195 

42.  Prof.  M.  Mazumdar . 

Dept,  of  Industrial  Engineering 
University  of  Pittsburgh 
Pittsburgh,  PA  15235 
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43.  Dr.  Sati  Mazumdar . 

Biostatistics  Dept. 

University  of  Pittsburgh 
Graduate  School  of  Public  Health 
Pittsburgh,  PA  15261 

44.  Prof.  Carl  N.  Morris . 

Statistics  Department 

Harvard  University 
1  Oxford  St. 

Cambridge,  MA  02138 

45.  Prof.  F.  W.  Mosteller . 

Department  of  Statistics 

Harvard  University 
1  Oxford  St. 

Cambridge,  MA  02138 

46.  Operations  Research  Center,  Rm  E40-164, 
Massachusetts  Institute  of  Technology 
Attn:  R.  C.  Larson  and  J.  F.  Shapiro 
Cambridge,  MA  02139 

47.  Dr.  John  Orav . 

Biostatistics  Department 

Harvard  School  of  Public  Health 
677  Huntington  Ave. 

Boston,  MA  02115 

48.  Dr.  Jim  Petty . 

National  Biological  Survey 

4200  New  Haven  Road 
Columbia,  MO  65201 

49.  Prof.  Maria  Rieders . 

Dept,  of  Industrial  Eng. 

Northwestern  Univ. 

Evanston,  IL  60208 

50.  Dr.  John  E.  Rolph . 

RAND  Corporation 

1700  Main  St. 

Santa  Monica,  CA  90406 
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51.  Prof.  M.  Rosenblatt . 

Department  of  Mathematics 
University  of  California,  San  Diego 

La  Jolla,  CA  92093 

52.  Prof.  Frank  Samaniego . 

Statistics  Department 

University  of  California 
Davis,  CA  95616 

53.  Prof.  W.  R.  Schucany . 

Dept,  of  Statistics 

Southern  Methodist  University 
Dallas,  TX  75222 

54.  Prof.  D.  C.  Siegmund . 

Dept,  of  Statistics 

Sequoia  Hall 
Stanford  University 
Stanford,  CA  94305 

55.  Prof.  H.  Solomon . 

Department  of  Statistics 

Sequoia  Hall 
Stanford  University 
Stanford,  CA  94305 

56.  Andrew  Solow . 

Woods  Hole  Oceanographic  Institute 
Woods  Hole,  MA  02543 

57.  Prof.  W.  Stuetzle . 

Department  of  Statistics 

University  of  Washington 
Seattle,  WA  98195 

58.  Dr.  D.  J.  Svensgaard . 

Health  Effects  Research  Lab 

U.  S.  Environmental  Protection  Agency 
Biostatistics  Branch  MD55 
Research  Triangle  Park,  NC  27711 
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59.  Prof.  J.  W.  Tukey . . 

Statistics  Dept,  Fine  Hall 
Princeton  University 
Princeton,  NJ  08540 


60.  Prof.  David  L.  Wallace . 1 

Statistics  Dept.,  University  of  Chicago 

5734  S.  University  Ave. 

Chicago,  IL  60637 

61.  Dr.  Ed  Wegman . 1 

George  Mason  University 

Fairfax,  VA  22030 

62.  Dr.  Alan  Weiss . 1 


Rm.  2C-118 

AT&T  Bell  Laboratories 
600  Mountain  Avenue 
Murray  Hill,  NJ  07974-2040 


63.  Dr.  P.  Welch . 1 

IBM  Research  Laboratory 

Yorktown  Heights,  NY  10598 

64.  Prof.  Roy  Welsch . 1 

Sloan  School 

M.I.T. 

Cambridge,  MA  02139 
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